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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
Applicants: Niels EMME 

Serial No.: New Application 
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For: MOBILE TERMINAL WITH DIGITAL CAMERA AND METHOD 

OF CAPTURING IMAGES 

PRELIMINARY AMENDMENT 

Assistant Commissioner for Patents December 31 , 2001 

Washington, D.C. 20231 

Sir: 

The following preliminary amendments and remarl<s are respectfully 
submitted in connection with the above-identified application. 

IN THE SPECIFICATION: 

Please replace the original specification with the attached Substitute 
Specification. 

IN THE CLAIMS: 

Please cancel claims 1-18 without prejudice or disclaimer and add the 
following new claims: 
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19. A mobile communication terminal comprising: 

a digital camera having an angle of view, the mobile communication terminal 
further comprising a source of infrared light for emitting a beam of infrared light, 
whereby the angle of view and the infrared light beam are directed such that a 
substantial part of the angle of view is overlapped by the infrared light beam so that 
objects in the angle of view may be illuminated by the infrared light beam. 

20. A mobile communication terminal according to claim 19, wherein: 
the source of infrared light is movable and the direction of the infrared light 

beam is substantially aligned with the angle of view. 

21 . A mobile communication terminal according to claim 1 9, comprising: 
an infrared filter that can be moved in and out of the light path into the camera. 

22. A mobile communication terminal according to claim 21 , wherein: 

the infrared filter has a first position in the light path and a second position out 
of the light path. 

23. A mobile communication terminal according to claim 22, comprising: 
an electro-mechanical or electronic actuator which moves the infrared filter 

from the first position to the second position and back. 

24. A mobile communication terminal according to claim 19, comprising: 
a display, which displays the image captured by the camera. 
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25. A mobile communication terminal according to claim 19, wherein: 
an image captured by tlie camera is refreshed at regular intervals. 



26. A mobile communication terminal according to claim 19, wherein: 
at least 60% of the viewing angle is overlapped by the infrared light beam. 

27. A mobile communication terminal according to claim 26, wherein: 
at least 80% of the viewing angle is overlapped by the infrared light. 

28. A mobile communication terminal according to claim 27, wherein: 
at least 90% of the viewing angle Is overlapped by the infrared light. 

29. A mobile communication terminal according to claim 19, wherein: 
the camera uses software which processes captured digital images. 

30. A mobile communication terminal according to claim 19, comprising: 
a focusing system which focuses the light coming into the camera, which 

provides a first setting adjusted to characteristics of visual light and a second setting 
adjusted to the characteristics of the infrared light. 

31 . A mobile communication tenninal according to claim 19, comprising: 
a lens cover, having a first position covering the lens of the camera and a 

second position exposing the lens. 
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32. A mobile communication temninal according to claim 31 , comprising: 
an actuator wliicli moves the lens cover from the first position to the second 

position and back. 

33. A mobile communication terminal according to claim 31 , comprising a 
handle having a first position associated with the first position of the lens cover, the 
handle having a second position associated with the second position of the lens 
cover and the first position of the infrared filter, and the handle having a third 
position associated with the second position of the infrared filter. 

34. A method of capturing infrared images comprising the steps of: 
providing a mobile communication temriinal comprising a digital camera and an 

infrared port; and 

Illuminating objects to be captured with infrared light emitted by the Infrared 

port. 

35. A method according to claim 34, comprising the step of: 
arranging the digital camera and the source of Infrared light in substantially a 

same direction on the mobile communication terminal. 

36. Method according to claim 34, further comprising the steps of: 
providing an infrared filter used when capturing images with visible light, and 



removing the infrared filter from the light path into the camera when 
capturing infrared images. 

37. Method according to claim 35, further comprising the steps of: 
providing an infrared filter used when capturing images with visible light, and 
removing the infrared filter from the light path into the camera when 
capturing infrared images. 

38. A method according to claim 34, wherein: 

the camera comprises an auto focus system and further comprising the step 
of adjusting settings of the auto focus system to characteristics of the infrared light 
when capturing infrared images. 

39. A method according to claim 34, wherein: 

the mobile communication temninal comprises a display and further 
comprising the step of displaying images captured by the digital camera on the 
display. 

40. A method according to claim 39, comprising the step of: 
capturing and displaying the images at intervals, permitting the mobile 

communication terminal to be used as a night vision device. 



IN THE ABSTRACT OF THE DISCLOSURE: 

Please amend the abstract as follows or, if abstract is more than one 
paragraph, use: Please replace the abstract with the following new abstract: 
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REMARKS 

Applicants submit herewith a Substitute Specification, along with a marked-up 
copy of the original specification for the Examiner's convenience. The substitute 
specification includes the changes as shown In the marked-up copy and includes no 
new matter. Therefore, entry of the Substitute Specification is respectfully 
requested. 

The claims have been amended to remove multiple dependent claims for fee 
calculation purposes and to improve the form of the claims for examination. 

The abstract has been amended to provide an abstract In proper format. 

Entry of the preliminary amendments and examination of the application is 
respectfully requested. 

To the extent necessary, applicant's petition for an extension of time under 37 
CFR 1 .136. Please charge any shortage in the fees due in connection with the filing 
of this paper, including extension of time fees, to Deposit Account No. 01-2135 
(1149.41056X00) and please credit any excess fees to such deposit account. 

Respectfully submitted, 

ANTONELL^ TERRY, STOUT & KRAUS, LLP 

Donald E.^tout 
Registration No. 26,422 

DES.alw 
(703)312-6600 
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MOBILE TERMINAL WITH DIGITAL CAMERA AND M ETHOD OF CAPTURING 

The present invention relates to mobile communication terminals, in particular mobile 
communication termlnal^TerminalsJhat comprise a source of infrared light, such as 
an infrared port and a digital camera. 

B ACKCROUreART . , /^ ^ i 

USfAj6,031 ,825 discloses a system for providing an infra red link between a mobile 
phone and its accessories. The mobile phone is provided with an Infrared transceiver 
comprising an infrared receiver and an infrared LED. The infrared port provides for a 
wireless connection between the phone and its accessories, such as a personal 
computer, a printer, or another phone to transmit data, audio, control and logical 
signals between them. 

Recently, mobile phones have been equipped with digital cameras. EP-A-0 898 405 
discloses a mobile phone provided with a digital camera and an infrared port. The 
mobile phone has an upper case and a lower case connected by a connection part. 
The infrared port and the digital camera are both arranged in a connection part, 
facing opposite directions. The camera can capture images using visible light. 

Charged Coupled Devices (CCDs) that are used in commercially available digital 
cameras are sensitive both to light in the visible spectrum and in the near infrared 
spectrum. These digital cameras are therefore provided with infrared filters so that 
interi^erence by any infrared light entering the camera is avoided. 

- D I SCLQSIJ RE OF THE INVENTION 

The availability of infrared light and the inherent sensitivity of CCDs to infrared light 
offers an hereto unrealized potential to use communication terminals equipped with 
an infra red port and a digital camera to capture infrared images. On this background, 
^ is an object ofjthe present invention J0 provide^a mobile phone of the kinc^referred 
to initially] which can be used to capture infrared images^is object is a^ie yed in ^ f 
accordance with claim 1 by providing ajmobile communication terminal 'comprisfflg a 
digital camera having an angle of view, the mobile communication terminal further 
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comprising a source of infrared light for emitting a beam of infrared light, whereby the 
angle of view and the infrared light beam are directed such that a substantial part of 
the angle of view is overlapped by the infrared light beam so that objects in the angle 
of view may be illuminated by the infrared light beam. 

5 

The source of infrared light may be movable so that the direction of the infrared light 
beam can be substantially aligned with the angle of view. 

The mobile communication temiinal may turner comprise an infrared filter that can 
10 be moved in and out of the light path into said camera. 

The mobile communication terminal may be provided with ampfrared filter that has a 
first position in sab light path and a second position out of satd light path. 

15 The mobile communication terminal may^omprise electro mechanical or electronic 
means to move sfe infrared filter from sakJ first position to^^td second position and 
back. 

The mobile communication temriinal may comprise a display, for displaying images 
20 captured by smi camera. The images captured by the camera may be refreshed at 
regular intervals. 

In a preferred embodiment at least 60% of the viewing angle is overlapped by the 
infrared light beam, preferably at least 80 % of the viewing angle is overlapped by tiie 
25 infrared light beam, and even more preferable at least 90% of the viewing angle is 
overiapped by the infrared light beam. 

The mobile communication tenminal may be provided with software for processing 
captured digital lmages. /vt^Ji^ * I 

The mobile communication terminal majA^mprise m o ano f orjocpsmg the light 
coming into camera, whereby Ipe^^et leewsiRg *ave a first setting 
adjusted to the characteristics of visual light and/a second setting adjusted to the 
(^aracteristics of infrared light. 
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The mobile communication tenninal may comprise a lens cover, having a first 
position covering the lens of said camera and a second position exposing sa|d^terjs^^ 
«€l^ mobile communication tenninal preferably further comprising rncano o^ 'actuattngg-3 
s& lens cover from the first position to the second position and back. 

The mobile communication tenminal niay comprise a handle having a first position 
associated with -slfcl first position of -said lens covrer. handle having a second 
position associated with s^ second position of «a»d lens cover and.^id first position 
of ead infrared filter, and handle having a third position associated with s»d/^ 
second position of said infrared filter 

jit is a further object _^^e present invention te- provido a method for captunng 
infrared images with a mobile communication tennina! equipped with a digital camera 
and an infrared port^hls object is achieved in accordance with claim 1 3, by 
providing a method of capturing infrared images comprising the steps of, 

- providing a mobite <x)mmunication terminal comprisir^g a digital camera and an 
infrared port, and 

- illuminating objects to be captured with the infrared light emitted by the infrared port. 

Preferably, ttie mettiod further comprises ttie step of anranging ttie digital camera and 
the source of infra red light substantially in the same direction on the mobile 
communication terminal. 

The method may further comprise the step of providing an infrared filter foruse when 
capturing images with visible light, and comprising the step of removing eatd infrared 
filter from the light path into the camera when capturing infrared images. 

Ms 

When eaid camera comprises an auto focus system, the method may further 
comprise the step of adjusting the settings of the auto focus system to the 
characteristics of infrared light when capturing infrared images. 

When ssH^ molsile communication terminal comprises a display, the method may 
further comprise the step of displaying images captured by the digital camera on the 
display. 
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The method may further comprise the step of capturing said images at short intervals 
thus, allowing the mobile communication terminal to be used as a night vision device. 

Further objects, features, advantages and properties of the^earing, shell and 
5 production methods according to thej? invention will become apparent from the 
detailed description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 In the following detailed portion of the present description, the invention will be 
explained in more detail with reference to the exemplary embodiments shown in the 
drawings, in which 

Fig. 1 shows in a perspective view the front of an embodiment of a communication 
terminal according to the invention, 
15 Fig. 2 shows in a perspective view the rear of an embodiment of a communication 
temiinal according to the invention with the lens exposed, 

Fig. 2a shows in a perspective view the rear of an embodiment of a communication 
terminal according to ttie Inverrtion with the tens covered, and 
Fig. 3 shows an embodiment of a mechanism for controlling the position of a cover 
20 for the camera module and for controlling the position of an infrared filter. 

DETAILED DESCRIPTION Of ~ri^^ Pdff^S^^^^ tfliMifllff,^ 

With reference to Figs. 1 and 2 a mobile communication terminal according to the 
25 invention in the fomi of a hand portable phone 1 , preferably a cellular/ mobile phone, 
provided with a camera wifrbe descritsed. The phone Ijfprovided with a front cover 2 
having a window frame 3 encircling the protection window of the display assembly. 
The phone comprises a user interface having an on/off button 4, a speaker 5 (only 
the openings are shown), a keypad 7, an LCD display 6 and a microphone (not 
30 shown). The LCD display may be a high resolution TFT matrix display for displaying 
high-resolution color pictures. The phone 1 further comprises a battery pack 1 1 . Th^ 
keypad comprises a first group of alphanumeric keys 8, two multi-function keys 9 (so- 
called soft keys), two call handling keys 12, and a scroll key 19. The functionality of 
the keys and the user interface is well known and not explained in detail here. 
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The mobile phone is provided with an infrared port 60. The infrared port is as such 
conventional and therefore not ail features described here are shown in the drawings. 
The infrared port comprises a cover 60 that is transparent to infrared light. An 
Infrared transceiver Is arranged under the cover 60. Commercially available infrared 
5 transceivers may be used in this application. The infrared transceiver comprises a 
source of Infrared light in the fonri of an Infrared LED (not shown). 
The LED emits a beam of infrared light through the cover 60 in a direction that is 
substantially perpendicular to the rear surface 33 of the mobile phone. The infrared 
port provides for a wireless conne<^on t>etween the phone 1 and its accessories, 
10 such as a personal computer, a printer, or another phone to transmit data, audio, 
control and logical signals between them. The general tennn "infrared light' as used 
Z. here includes light with a wavelength of 770 to 1 000 Mm. Infrared transceivers as 

fz used for infrared ports on mobile phones operate typically with a wavelength of 850- 

^ 900 pm. 

£ 15 

E The camera in ttie mobile phone is a conventional digital camera and therefore not all 

= the featojres of ttie <»mera are shown. The ramera uses one or more Charge 

t Coupled Devices (CCDs) (not shown) for capturing images. The camera is further 

if. provided with a tens 36 and an auto focus system (not shown). A lens cover 42 

S 20 protects the lens 36 and the camera from dust, direct sunlight and mechanical 
M: contact when tlie camera is turned off. The lens cover 42 is a slide cover that makes 

a sliding movement between a camera non-operating position, in w^ich it covers at 
least the lens 36 and a camera operating position at which the lens is exposed. The 
camera is an-anged at the rear of the mobile phone in the battery pack 1 1 . The 
25 camera direction is therefore substantially perpendicular the to the rear surface 33 of 
the mobile phone 1. The camera has thus an angle of view directed away from the 
rear surface 33 of the mobile phone 1 . 

Standard CCD devkjes are sensitive to both visual light and near infrared light. 
30 Conventional digital cameras for capturing images with visual light are therefore 
provided with an Infrared fitter for preventing influences of infrared light on the 
captured image. The mobile phone 1 is also provided with an infrared filter 43. 
The infrared filter 43 can though be moved out of the path of the light into the camera 
for capturing infrared images. 

35 
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The tens 36 is preferably a fixed focal tength lens witl^movable lens group to allow 
auto focus, however, lens 36 could be any plurality of lens providing for adjustment to 
focus on different parts of the image received, as will be understood to those skilled 
in the art. The characteristics of visible light and near infrared light with respect to 
5 focusing are slightly different. Therefore, the auto focus system has two settings; a 
first setting for capturing images with visual light and a second setting for infrared 
light. 

A standard software for processing, storing and recalling pictures captured with 
10 visual light and captured with infrared light is installed on the phone 1 . This software 
may as such be conventional and commercially available. The software is also able 
to control the refresh rate of the images shown on the display and the refresh rate of 
the captured images. 

15 A mechanism for moving the lens cover 42 is described with reference to Figs. 3a to 
3c. The mechanism comprises a wheel 40, a lens cover 42 and a connection 
between the wheel 40 and the tens cover 42. The connection consists of a first link 
46 and a second link 44 being connected in a joint 48. The first link 46 is attached to 
the lens cover 42 via a pivot point 45. The first link 47 is connected to the wheel 40 

20 by a pivot point 47. The mechanism can move the lens cover 42 from a first, closed 
portion to a second positfen and vice versa. An infrared filter 43 is connected to the 
lens cover 42 and moves integrally with the lens cover 42. In the second position of 
the lens cover 42, the infrared filter 43 is in the path of the light falling into the camera 
(Fig 3b). There could of course be only one link or more than two links in the 

25 connection between the cover 42 and the wheel 40. The descritsed mechanism has 
been simplified in that it does not include bearing, guiding elements, etc. to just show 
the essential parts of the mechanism. The wheel may be driven by an electrical 
actuator such as an electric motor or an electromagnetic actuator (not shown) or by a 
mechanical actuator such as a handle 49. As the wheel 40 is rotated, the link 

30 mechanism 45,46, will translate the rotating motion of the wheel 40 into a linear 

motion 53 of the lens cover 42 and the infrared filter 43. Infiglfe 3a, the lens cover is 
in jjs first position where it covers and protects the camera lens 36 (not shown in 
4igt^ 3a). The infrared filter 43 is in a parked positron v^rtiere it has no direct function. 
To move the lens cover 42 from its dosed position, to its second position, and the 

35 infrared filter 43 from its pari<ed position to its first position, the position in which the 
infrared filter 43 is in the light path into the camera, the wheel 40 is rotated in a 
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clockwise direction 51 to move the pivot point 47 substantiaHy above the center of the 
wheel as shown In Fig. 3b. When the lens cover 42 is moved to its second position, 
the open position, and the infrared filter 43 is moved to its first position, the camera 
lens 36 is exposed to the visible light, and the camera can be used to capture images 
5 with visible light. To move the lens cover back to its first position, the wheel 40 is 
rotated anticlockwise (not shown). 

To move the infrared filter 43 to its second position, where it is not in the light path 
into the camera, the wheel 40 is rotated further in a clockwise direction 51 to move 

10 the pivot point 47 to t>e located to the right from the center of rotation as shown in 
Fig. 3c. The lens cover 42 is now In its third position, which is also an open position, 
and the infrared filter is in its second position, in which it is not in the light path into 
the camera. The tens is now also exposed to infrared light, and can be used to 
capture images with infrared light. In this position of the infrared filter, the infrared 

15 LED of the infrared port can be activated. The angle of view of the camera and the 
light beam emitted by the infrared LED are aimed in substantially the same direction. 
There is thus a substantial overlap of the angle of view and the infrared light beam so 
tiiat objects tn the angle of view of the camera are flluminated by the infrared light 
beam. 

20 The infrared light beam overiaps preferably more than 60% of the angle of view and 
even more preferable more than 80% of the angle of view is overlapped by the 
infrared light beam. Thus, when the camera is aimed at an ol^et^ to be 
photographed, the light emitted by the infrared LED wtH also iae directed to the object 
to fc>e photographed which -win-be illuminated with infrared light to enhance light 

25 intensity at which infrared images earrije captured. 

In another emt>odiment (not shown) the infrared port may also tie arranged movable 
with respect to the mobile phone 1. Thus, the direction of the light beam emitted by 
the infrared LED can be directed towards an object to be illuminated. 

30 

The camera may be provided with further filters (not shown) such as ultraviolet 
filters, optical low and high pass filters of various wavelengths of visible light as 
known to those skilled in the art. Those skilled in the art will realize other filter may be 
used. The image sensor may comprise any of the known (^figurations fpr solid- 
35 state image sensors, such as frame transfer, interline tran|ff r CCDs, or c^e an-ays. 



8 

The captured images are shown on the display 6. In one mode of the mobile phone 1 
stored images are displayed, whereas the images refreshed at a regular refresh rate 
are displayed in a second mode of the camera. When capturing infrared images in 
the second mode the mobile phone 1 may be used as a night vision device. 

5 

Although one single actuating mechanism for controlling the lens cover and the 
infrared filter has been shown, it is possible to use a first mechanism for the lens 
cover and another mechanism for the infrared filter. The shown mechanism is 
mechanical. Other actuating mechanisms for controlling the position of the lens cover 

10 are of course also within the scope of the invention. Such mechanisms can be 

electro-mechanical, or electronic or other actuating devices generally used in camera 
technology. The camera has been shown as arranged in the battery pack 1 1 of the 
mobile phone, but it is understood that the camera could be arranged in other places 
in the mobile phone. The same applies to the location of the infrared port, as long as 

15 the view angle of the camera and the light beam of the infrared port can have a 
substantial overlap. 
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ABSTRACT 

MOBILE TERMtNAL WITH DiGtTAL CAMERA AND METHOD OF CAPTURING 
IMAGES 

The invention relates to a mobile communication terminal provided with a digital 
camera and an infrared port. The digital camera and the infrared port are arranged 
such that the infrared light emitted by the infrared port can be used to capture Images 
with infrared light. 
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